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Optimal transport over a linear dynamical system 

Yongxin Chen, Tryphon Georgiou and Michele Pavon 


Abstract 

We consider the problem of steering an initial probability density for the state vector of a linear system to a 
bnal one, in finite time, using minimum energy control. In the case where the dynamics correspond to an integrator 
{x{t) = u{t)) this amounts to a Monge-Kantorovich Optimal Mass Transport (OMT) problem. In general, we show 
that the problem can again be reduced to solving an OMT problem and that it has a unique solution. In parallel, 
we study the optimal steering of the state-density of a linear stochastic system with white noise disturbance; this 
is known to correspond to a Schrodinger bridge. As the white noise intensity tends to zero, the flow of densities 
converges to that of the deterministic dynamics and can serve as a way to compute the solution of its deterministic 
counterpart. The solution can be expressed in closed-form for Gaussian initial and final state densities in both cases. 


Keywords: Optimal mass transport, Schrodinger bridges, stochastic linear systems. 


I. Introduction 

We are interested in stochastic control problems to steer the probability density of the state-vector of 
a linear system between an initial and a final distribution for two cases, i) with and ii) without stochastic 
disturbance. That is, we consider the linear dynamics 

dx{t) = A{t)x(t)dt + B{t)u{t)dt + y/eB{t)dw{t) (1) 

where w is a Wiener process, m is a control input, x is the state process, and {A, B) is a controllable pair 
of matrices, for the two cases where i) e > 0 and ii) e = 0. In either case, the state is a random vector 
with an initial distribution /xq. Our task is to determine a minimum energy input that drives the system 
to a final state distribution /xi over the time intervaQ [0, 1], that is, the minimum of 

E{ f Mt)fdt} (2) 

Jo 

subject to Hi being the probability distribution of the state vector at f = 1. 

When the state distribution represents density of particles whose position obeys x{t) = u{t) (i.e., 
A{t) = 0, B{t) = I, and e = 0) the problem reduces to the classical Optimal Mass Transport (OMT) 
problerrj^ with quadratic cost [|71. Thus, the above problem, for e = 0, represents a generalization 
of OMT to deal with particles obeying known “prior” non-trivial dynamics while being steered between 
two end-point distributions - we refer to this as the problem of OMT with prior dynamics (OMT-wpd). 
The problem of OMT-wpd was first introduced in our previous work [fTOll for the case where B{t) = I. 
The difference of course to the classical OMT is that, here, the linear dynamics are arbitrary and may 
facilitate or hinder transport. Applications are envisioned in the steering of particle beams through time- 
varying potential, the steering of swarms (UAV’s, large collection of microsatelites, etc.), as well as in 
the modeling of the flow and collective motion of particles, clouds, platoons, flocking of insects, birds, 
fish, etc. between end-point distributions ifTTI . and the interpolation/morphing of distributions ifT^ . 

'There is no loss in generality having time window [0,1] instead of, the more general [fo,fi]. This is done for notational convenience. 
^Historically, the modem formulation of OMT is due to Leonid Kantorovich (T) and has been the focus of dramatic developments because 
of its relevance in many diverse fields including economics, physics, engineering, and probability (2), 0, 0, 0, g), Q, 0, 0, 0, 0. 
Kantorovich’s contrihutions and the impact of the OMT to resource allocation was recognized with the Nobel Prize in Economics in 1975. 
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In the case where e > 0 and a stochastic disturbance is present, the flow of “particles” is dictated by 
dynamics as well as by Brownian diffusion. The corresponding stochastic control problem to steer the 
state density function between the end-point distributions has been recently shown to be equivalent to 
the so-called Schrodinger bridge problen^ ll^ . [|23l, [|2^ . The Schodinger bridge problem can be seen 
as a stochastic version of OMT due to the presence of the diffusive term in the dynamics. As a result, 
its solution is more well behaved due to the smoothing property of the Laplacian. On the other hand, 
it follows from [l25ll . fl271 . [|28l that for the special case A{t) = 0 and B{t) = /, the solution to 

the Schrodinger bridge problem tends to that of the OMT when “slowing down” the diffusion by taking 
e —0. These two facts suggest the Schrodinger bridge problem as a means to construct solutions to OMT 
for both, the standard one as well as the problem of OMT with prior dynamics. 


The present work begins with an expository prologue on OMT (Section |^. We then develop the 
theory of OMT-wpd (Section III) and establish that OMT-wpd always has a unique solution. Next we 
discuss in parallel the theory of the Schodinger bridge problem for linear dynamics and arbitrary end-point 
marginals (Section |IV]). We focus on the connection between the two problems and in Theorem we 
establish that the solution to the OMT-wpd is indeed the limit, in a suitable sense, of the corresponding 
solution to the Schrodinger bridge problem. In Section |V] we specialize to the case of linear dynamics with 
Gaussian marginals, where closed-form solutions are available for both problems. The form of solution 
underscores the connection between the two and that the OMT-wpd is the limit of the Schrodinger bridge 
problem when the diffusion term vanishes. In Section |V^ we work out two academic examples to highlight 
the relation between the two problems (OMT and Schrodinger bridge). 


II. Optimal mass transport 

Consider two nonnegative measures po, on having equal total mass. These may represent 
probability distributions, distribution of resources, etc. In the original formulation of OMT, due to Caspar 
Monge, a transport (measurable) map 

T : : x^T{x) 

is sought that specifies where mass po{dx) at x must be transported so as to match the final distribution 
in the sense that Tjj/xo = bi, i-e. /xi is the “push-forward” of po under T meaning 

= ^Lo{T-HB)) 

for every Borel set in MA. Moreover, the map must incur minimum cost of transportation 

Here, c{x, y) represents the transportation cost per unit mass from point x to point y and in this section 
it will be taken as c{x,y) = \\\x — y\\^. 

The dependence of the transportation cost on T is highly nonlinear and a minimum may not exist. 
This fact complicated early analyses to the problem due to Abel and others [l3]|. A new chapter opened 
in 1942 when Leonid Kantorovich presented a relaxed formulation. In this, instead of seeking a transport 
map, we seek a joint distribution n(/xo, di) on the product space MA x M” so that the marginals along the 

^The Schrodinger bridge problem, in its original formulation (HI, m, ini, seeks a probability law on path space with given two 
end-point marginals which is close to a Markovian prior distribution in the sense of large deviations (minimum relative entropy). Early 
important contributions were due to Fortet, Beurling, Jamison and Follmer 1161 . 1171 . 1181 . 1191 while renewed interest was sparked after a 
close relationship to stochastic control was recognized l20l . ED, EH 
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two coordinate directions coincide with hq and ni respectively. The joint distribution n(/io,/xi) is refered 
to as “coupling” of /xq and /ii. Thus, in the Kantorovich formulation we seek 

inf j h\x-yfdT:{x,y) (3) 

7ren(Ato,MiJ Jr>ixR" ^ 

When the optimal Monge-map T exists, the support of the coupling is precisely the graph of T, see [|3l . 


Formulation Q represents a “static” end-point formulation, i.e., focusing on “what goes where”. 
Ingenious insights due to Benamou and Brenier JTl and [|29l led to a fluid dynamic formulation of OMT. 
An elementary derivation of the above was presented in [fTOl which we now follow. OMT is first cast as 
a stochastic control problem with atypical boundary constraints: 

x'^it) = v{t,x''{t)), (4b) 

(4c) 


Here V represents the family of continuous feedback control laws. From this point on we assume that yo 
and yi are absolutely continuous, i.e., yo{dx) = po{x)dx, yi{dy) = pi{y)dy with corresponding 

density functions, and accordingly a distribution for x’'(f) ~ p{t,x)dx. Then, p satisfies weakl)]^ the 
continuity equation 

+ V ■ {vp) = 0 (5) 

expressing the conservation of probability mass and 

/ h\v{t,x^{t))fdt\= [ f h\v{t,x)fp{t,x)dtdx. 

IJo ^ J Jo ^ 


As a consequence, Q is reformulated as a “fluid-dynamics” problem (71: 

f f h\'v{t,x)fp{t,x)dtdx, 
\px) Jwx Jo ^ 

| + v.M = o. 

p(0, x) = pq[x), p(l, y) = px[y). 


(6a) 

(6b) 

(6c) 


A. Solutions to OMT 

Assuming that po, pi are absolutely continuous (dpo{dx) = po{x)dx and dpi{dx) = pi{x)dx) it is a 
standard result that OMT has a unique solution Il30ll . [[3]| , [|4ll and that an optimal transport T map exists 
and is the gradient of a convex function (j), i.e., 

y = T{x) = V(j){x). (7) 

By virtue of the fact that the push-forward of po under V0 is pi, this function satisfies a particular case 
of the Monge-Ampere equation ^ p.l26], [|7l p.377], namely, det(i70(a:))pi(V0(x)) = po{x), where H(j) 
is the Hessian matrix of 0, which is a fully nonlinear second-order elliptic equation. The computation of 
0 has received attention only recently Q, lfT2ll where numerical schemes have been developed. We will 
appeal to the availability of 0 in the sequel without being concerned about its explicit computation. 

'’in the sense that, + v ' Vf)pdxdt = 0 for smooth functions / with compact support. 
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Having T, the displacement of the mass along the path from f = 0 to f = 1 is 

Tt{x) = (1 - t)x + tT{x) (8a) 

while Ht is absolutely continuous with derivative 

p{t,x) = d^t{.x)/dx. (8b) 

Then, v{t,x) = T o Tf^{x) — Tf^{x) and p{t,x) together solve ©• Here o denotes the composition of 
maps. 


B. Variational analysis 


In this subsection we briefly recapitulate the sufficient optimality conditions for a pair (p(-, •), r;(-, •)) 
to be a solution of (|^ from [|71 (see also [fTOl Section II] for an alternative elementary derivation). 


Proposition 1: Consider p*{t,x) with t G [0,1] and x G M”, that satisfies 

^ + V-(V^p*)=0, p*(0,a;)=po(a:), 

where -0 is a solution of the Hamilton-Jacobi equation 

If in addition 

p*{l,x) = pi{x), 

then the pair {p*,v*) with v*{t,x) = V'ip{t,x) is a solution of (|^. 


(9a) 

(9b) 

(9c) 


The stochastic nature of the Benamou-Brenier formulation @ stems from the fact that initial and 
final densities are specified. Accordingly, the above requires solving a two-point boundary value problem 
and the resulting control dictates the local velocity field. In general, one cannot expect to have a classical 
solution of ( |9bl ) and has to be content with a viscosity solution. Let -0 be a viscosity solution of ( |9bl ) that 
admits the Hopf-Lax representation ||3l p. 174] p. 4] 


y I 


2t 


t G (0,1] 


with 


'ijj{0,x) = (j){x) — -||x||^ 


and 0 as in 0, then this -0 together with the displacement interpolation p in 0 is a solution to Q. 


HI. Optimal mass transport with prior dynamics 


Optimal transport has also been studied for general cost c(x, y) that derives from an action functional 


c{x,y) 


inf [ L{t,x{t),x{t))dt, 

x£Xxy Jq 


( 10 ) 


where the Lagrangian L{t, x,p) is strictly convex and superlinear in the velocity variable p, see (H Chapter 
7], dsn Chapter 1], d32l. Existence and uniqueness of an optimal transport map T has been establishecQ 


^OMT has also been studied and similar results established for R" replaced by a Riemannian manifold. 
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for general eost funetionals as in ( [T^ . It is easy to see that the ehoice c{x, y) = ^||a: — y\\^ is the special 
case where 

Another interesting special case is when 

L{t,x,p) = ]^\\p-v{t,x)\\^. (11) 

This has been motivated by a transport problem “with prior” associated to the velocity field v{t,x) im 
Section VII]. There the prior was thought to reflect a solution to a “nearby” problem that needs to be 
adjusted so as to be consistent with updated estimates for marginals. 


An alternative motivation for ( [TT] ) is to address transport in an ambient flow field v{t, x). In this case, 
assuming the control has the ability to steer particles in all directions, transport will be effected according 
to dynamics 

x{t) = v{t, x) + u{t) 

where u{t) represents control effort and 


-\\u{t)rdt = 


-\\x{t) - v{t,x)fdt 


represents corresponding quadratic cost (energy). Thus, it is of interest to consider more general dynamics 
where the control does not affect directly all state directions. One such example is the problem to steer 
inertial particles in phase space through force input (see [|2^ and ll^ where similar problems have been 
considered for dynamical systems with stochastic excitation). 


Therefore, herein, we consider a natural generalization of OMT where the transport paths are required 
to satisfy dynamical constraints. We focus our attention on linear dynamics and, consequently, cost of the 
form 


c{x,y) 


inf / L{t,x{t),u{t))dt, where 


u 


x{t) = A{t)x{t) + B(t)u{t), 
a;(0) = X, x(l) = y, 


(12a) 

(12b) 

(12c) 


and U is a suitable class of control^ This formulation extends the transportation 
manner as optimal control generalizes the classical calculus of variations fl34l (albeit 
dynamics). It is easy to see that ( fTTj ) corresponds to A(f) = 0 and B{t) the identity 
B{t) is invertible, ( [T^ reduces to ( fTOj ) by a change of variables, taking 


problem in a similar 
herein only for linear 
matrix in ( [T^ . When 


L{t,x,p) = L{t,x, B{t) ^{p — A{t)x)). 


However, when B{t) is not invertible, an analogous change of variables leads to a Lagrangian L(t,x,p) 
that fails to satisfy the classical conditions (strict convexity and superlinearity in p). Therefore, in this 
case, the existence and uniqueness of an optimal transport map T has to be established independently. 
We do this for the case where L{t,x,u) = ||m|P/ 2 corresponding to power. 


We now formulate the corresponding stochastic control problem. The system dynamics 

x{t) = A{t)x(t) + B{t)u{t), 


( 13 ) 


®Note that we use a common convention to denote by a: a point in the state space and by x{t) a state trajectory. 
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are assumed to be eontrollable and the initial state x(0) to be a random veetor with probability density 
Po- We seek a minimum energy eontinuous feedbaek eontrol law u{t,x) that steers the system to a final 
state a;(l) having distribution pi{x)dx. That is, we address the following: 

infE{^ ^\\u{t,x'^)fdt^ , (14a) 

= A{t)x'^{t) + B{t)u{t), (14b) 

x“(0) ~ po, a;“(l) ~ pi, (14o) 

where U is the family of eontinuous feedbaek eontrol laws. Onee again, this ean be reeast in a “fluid- 
dynamies” version in terms of the sought one-time probability density funetions of the state veetor: 


inf / / -\\u{t, x)\\‘^p{t,x)dtdx, 

(p>“) Jr” Jo 2 

+ V ■ {{A{t)x + B{t)u)p) = 0, 
p(0, x) = po{x), p(l, y) = pi{y). 


(15a) 

(15b) 

(15e) 


Naturally, for the trivial prior dynamies A{t) = 0 and B{t) = I, the problem reduees to the elassieal 
OMT and the solution {p(f, •) I 0 ^ ^ ^ 1 } is the displacement interpolation of the two marginals [l29l . 
In the rest of the seetion, we show direetly that Problem ( [T5| ) has a unique solution. 


A. Solutions to OMT-wpd 


Let $(fi,fo) be the state transition matrix of ( pA] ) from to to fi, with $io := $(1,0), and 

Mio := M( 1 , 0 ) = f <!>{l,t)B{t)B{ty<l>{l,tydt 

Jo 

be the eontrollability Gramian of the system. Reeall [1^ . [|^ that for linear dynamies ( [T3| ) and given 
boundary eonditions a:(0) = x, a:(l) = y, the least energy and the eorresponding eontrol input ean be 
given in elosed-form, namely 


inf f ^\\u{t)fdt = ^{y - $ioa;)'Mio^(|/ - $iox) 


whieh is attained for 


M(f)=5(f)'$(l,f)'Mfoi(p-$iox), 
and the eorresponding optimal trajeetory 

x{t) = $(f, 1)M(1, f)M{o^$ioX + M(f, 0)$(1, tyM^^y. 

Problem ( [T4l ) ean now be written as 


inf 


-{y- $ioa;) M^q iv “ ^iox)d7r{x, y) 



d7i{x, y) = po{x)dx, 


dx J 



dTi{x,y) = pi{y)dy, 


dy J 


(16) 


(17) 


(18a) 

(18b) 


where vr is a measure on x M”. 
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Problem ( [T8] ) can be converted to the Kantorovich formulation @ of the OMT by a transformation 
of coordinates. Indeed, consider the linear map 


C 


X 


X 



. y. 


. y. 


Mp'^y 


(19) 


and set 


TT = CjjTT. 


Clearly, (1^ 18b) become 



dx J yG'R'^ 


where 



inf 

f 

h\y - xfdn{x,y) 

(20a) 



'R"xE" 

z 


d7t{x, 

y) = 

--Po{x)dx, / / dTi{x,y) = pi{;y)dy, 

Jdy J aigR" 

(20b) 


= 

|Mio| 



pi{y) 

= 

iMiol 




Problem ( |20| ) is now a standard OMT with quadratic cost function and we know that the optimal transport 
map T for this problem exists. It is the gradient of a convex function 0, i.e., 

f = V0, (21) 

and the optimal tt is concentrated on the graph of T jSOll. The solution to the original problem ( |20l ) can 
now be determined using T, and it is 

y = T{x) = f (M-'/'-hiox). 


The one-time marginals can be readily computed as the push-forward 

= (^i)tt/^0) 

where 


( 22 ) 

(23a) 


Tt{x) = $(f,l)M(l,f)Mfo'<hiox + M(f,0)<I)(l,f)'Mro'T(a;), (23b) 

and 


p(t,x) = dfit{x)/dx. (23c) 

In this case, we refer to the parametric family of one-time marginals as displacement interpolation with 
prior dynamics. 













B. Variational analysis 


In this section we present a variational analysis for the OMT-wpd ( [T5| ) analogous to that for the OMT 
problem (Tl, [|T0l Section II]. The analysis provides conditions for a pair {■,■)) to be a solution 

to OMT-wpd and will be used in Section |V] to prove optimality of the solution of the OMT-wpd with 
Gaussian marginals. 

Let "Ppopi be the family of flows of probability densities satisfying the boundary conditions and hi 
be the family of continuous feedback control laws «(■,■)■ Consider the unconstrained minimization over 
'Ppopi X W of the Lagrangian 

r rl 


C(p,M, A) = 


'0 L 


^\\u{t,x)\\'^p{t,x) + X{t,x) ( + V - {iA{t)x + B{t)u)p) 


dtdx, (24) 


where A is a Lagrange multiplier. After integration by parts, assuming that limits for x —)■ oo are zero, 
and observing that the boundary values are constant over we get the problem 


"1 r 


inf / 

(p,u)&'PpQp^xU Jjgn 


(9A 

^||w(f,x)r + ( - VA ■ {A{t)x + B{t)u) 


p{t, x)dtdx. 


Pointwise minimization with respect to u for each fixed flow of probability densities p gives 

u*{t,x) = B{ty'VX{t,x). 


Substituting into ( |25] ), we get 

J(p, A) = - / 


'1 rn\ 1 

— + A{t)x ■ VA + -VA ■ B{t)B{t)VX 


'0 L 


dt 


pit, x)dtdx. 


(25) 


(26) 


(27) 


As in Section II-B we get the following sufficient conditions for optimality: 

Proposition 2: Consider p* that satisfies 

do* 

^ + V ■ [{A{t)x + B{t)B{tyvy^)p*] = 0, p*(0, x) = po{x), 

where -0 is a solution of the Hamilton-Jacobi equation 

^ + x'Aitywyj + ^V0'5(f)s(f)'v0 = o. 


If in addition 


p*(l,x) = pi(x), 


(28a) 

(28b) 

(28c) 


then the pair {p*{t,x),u*{t,x) = B{tyVip{t,x)) is a solution to problem ( [T5] ). 

It turns out that ([28]) always admits a solution. In fact, one solution can be constructed as follows. 


Proposition 3: Given dynamics ( fT3| ) and marginal distributions po{dx) = po{x)dx, pi{dx) = pi{x)dx, 
let ip{t,x) be defined by the formula 


0(f,x) = inf ( 0 ( 0 , 2 /) + ((x - <l)(f, 0 ) 2 /)'M(f, 0) \x - 


y I 


(29) 


with 


0(0, x) = 0(Mio^/^<Liox) - ^x'T>0Mio^$iox 


and 0 as in pT] ). Moreover, let p{t, ■) = (T^jpo be the displacement interpolation as in ( |2^ . Then this 
pair (0,p) is a solution to 
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Proof: First we show that ( |29l ) satisfies ( |28b[ ). Let H{t,x, Vip) be the Hamiltonian of the Hamilton- 


Jaeobi equation (28b), that is, 


VV') = x'Afyvp: + 


and define 


L{t,x,v) = sup{p ■ V — H{t,x,p)} 


( ^{v — A{t)xy{B{t)B{tyy{v — A{t)x) if u — A{t)x G 7^(-B) 

I oo otherwise, 

where f denotes pseudo-inverse and 7l{-) denotes “the range of”. Then the Bellman principle of optimality 
yields a partieular solution of ( |28b[ ) 

f(t,x) = inf |v’o(l/) + / L(r,^(r),^(r)), p^(t) = x, Of) = y 


= {fo{y) + - ^{t,0)yyM{t,0) ^{x-^{t,0)y) 


This shows that ( |29| ) is indeed a solution of ( |28b[ ). 

Next we show {yj,p) is a (weak) solution of ( |28a[ ). Define 

v{t, x) = A{t)x + B{t)B{ty'Vyj{t, x), 


| + v.M = o. 


(30) 


then ( |28a| ) beeomes a linear transport equation 

with veloeity field v{t,x). We claim 

v(t, ■)oTt = dTt/dt, 

that is, v{t, x) is the velocity field associated with the trajectories {Tf). If this claim is true, then the linear 
transport equation ( [SO] ) follows from a standard argument (3] p. 167]. Moreover, the terminal condition 
( |28c| ) follows since p(l, •) = Tjpo- We next prove the claim. Formula can be rewritten as 

g{x) = sup [x'M{t, 0)y - f{y)} , 


with 


The function 


dix) = -x'M{t,0) ^x — ijj{t,x) 

f{y) = ^y'<!>{t,0yM{t,0)-^<!>{t,0)y + 'iP{0,y). 


f{y) = ^f^t,0yM{t,0)-^^t,0)y + my) 

1 


= y [$(f, 0)'M(f, 0)-'$(f, 0) - y + 


is convex since 6 is convex and the matrix 


$(f,0)'M(f,0)-i<l>(f,0)-<h;oMroi<hio = / $(0,r)i?(r)i?(r)'$(0,r)'dr 


-1 


$(0,r)5(r)5(r)'<I>(0,r)'dr 


1 


-1 
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is positive semi-definite. Henee, from a similar argument to the ease of Legendre transform, we obtain 

Vg o (M(f, 0)<f>(0, tyvf) = M{t, 0). 

It follows 

(M(f, 0)-^ - ■)) ° {M{t, 0)<1'(0, ty 0)a: + V^/>(0, x)] } = M{t, 0)x. 

After some eaneellations it yields 

V'0(f, •) o <l)(f, 0)a; -f Vyj{t, •) o M{t, 0)<l>(0, tyvyj{0,x) — <l'(O,f)'V'0(O, x) = 0. 

On the other hand, sinee 

T{x) = = M,o<^^,,V'iP{0,x) + <DioX, 

we have 


Ttix) = $(f,l)M(l,f)Mro'<I>iox + M(f,0)$(l,f)'Mfo'T(a;) 
= $(f, 0)a;-f M(f, 0)<l>(0, f)'V'^(0, x), 


from whieh it follows 

dT lx') 

= A(f)$(f, 0)a: -f 0)<1'(0, f)'V^/>(0, x) + B{t)B{ty<!>{0, f)'VV'(0, x). 

Therefore, 

dTAx'] 

u(f, •) oTt{x) - = [A{t) + B{t)B{tyV'ijj{t,-)] o [$(f, 0)a; + M(f, 0)<l)(0,f)'V?/'(0,x)] 

- 0)a: + A{t)M{t, 0)<l'(0, f)'V^/>(0, x) + B{t)B{ty^{0, f)'Vt/>(0, x)] 

= B{t)B{ty •) o ^t, 0)a: + •) o M{t, 0)<I)(0, t)'VV’(0, x) 

-mtyvmy)} 

= 0 , 


whieh eompletes the proof. 


IV. SCHRODINGER BRIDGES AND THEIR ZERO-NOISE LIMIT 

In 1931/32, Sehrodinger lfT3l . [fT4ll treated the following problem: A large number N of i.i.d. Brownian 
partieles in MA is observed to have at time / = 0 an empirieal distribution approximately equal to po{x)dx, 
and at some later time / = 1 an empirieal distribution approximately equal to pi{x)dx. Suppose that pi{x) 
eonsiderably differs from what it should be aeeording to the law of large numbers, namely 

j q^{0,x,l,y)po{x)dx, 

where ^ 

q‘>(s,x,t,y) = (27r)-"/2(«- s)-"/2exp 

denotes the Brownian transition probability density. It is apparent that the partieles have been transported 
in an unlikely way. But of the many unlikely ways in whieh this eould have happened, whieh one is 
the most likely? The proeess that is eonsistent with the observed marginals and fulfils Sehrodinger’s 
requirement is referred to as the Sehrodinger bridge. 

This problem has a long history IfTSlI . In partieular, Follmer IfT^ showed that the solution to Sehrodinger’s 
problem eorresponds to a probability law on path spaee that minimizes the relative entropy with respeet 
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to the Wiener measure among all laws with given initial and terminal distributions, po{x)dx and p\{x)dx, 
respectively, and proved that the minimizer always exists. Beurling IfTTlI and Jamison liTSl generalized 
the idea of the Schrodinger bridge by changing the Wiener measure to a more general reference measure 
induced by a Markov process. Jamison’s result is stated below. 


Theorem 1: Given two probability measures pQ^dx) = po{x)dx and pi{dx) = pi{x)dx on and the 
continuous, everywhere positive Markov kernel q{s, x,t,y), there exists a unique pair of a-finite measure 
{(po{x)dx, ip!i{x)dx) on MT such that the measure Vqi on MT x M"" defined by 


VoiiE)= [ q{0,x,l,y)Lpo{x)ipi{y)dxdy (31) 

J E 

has marginals pq and pi. Furthermore, the Schrodinger bridge from /iq to pi is determined via the 
distribution flow 


Vt{dx) 

= (fit, x)(p(t, x)dx 

(32a) 

(p{t,x) = 

j (l{t,x,l,y)Ti{.y)dy 

(32b) 

0{t,x) = 

j qiO,y,t,x)(po{y)dy. 

(32c) 


The flow ( |32l ) is referred to as the entropic interpolation with prior q between po and pi, or simply 
entropic interpolation, when it is clear what the Markov kernel q is. An efficient numerical algorithm to 
obtain the pair ((^q, and thereby solve the Schrodinger bridge problem is given in ||371 . 


For the case of non-degenerate Markov processes, a connection between the Schrodinger problem and 
stochastic optimal control was drawn by Dai Pra Il20ll . In particular, for the case of a Brownian kernel, 
he showed that the one-time marginals p(f, x) for Schrodinger’s problem can be obtained as solutions to 


inf / 

ipx) Jmx 


»1 

-||u(f, x)\\‘^p(t, x)dtdx, 


| + v.M-1ap = o, 

p(0,a;) = po(a^), p(l, 1/) = Pi(l/)- 


(33a) 

(33b) 

(33c) 


Here, ( |33a| ) is the infimum of the expected cost while ( |33b[ ) is the corresponding Fokker-Planck equation. 
The entropic interpolation is Vt{dx) = p{t,x)dx. 


An alternative equivalent reformulation given in ffTOl is 


“1 r 


inf / i 

(px) Jm-n J 

| + v.M = o. 




pit, x)dtdx, 


(34a) 


(34b) 

p(0,x) = po(a;), P(l,2/) = Pi(2/), (34c) 

where the Laplacian in the dynamical constraint is traded for a “Fisher information” regularization term 
in the cost functional. Although the form in ( |34l ) is quite appealing, for the purposes of this paper we 
will use only ([3^. 


Formulation ( [3^ is quite similar to OMT @ except for the presence of the Laplacian in ( |33b[ ). It 
has been shown Il27ll . [[28l . [[25ll . fl26l that the OMT problem is, in a suitable sense, indeed the limit of 
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the Schrodinger problem when the diffusion eoeffieient of the referenee Brownian motion goes to zero. 
In partieular, the minimizers of the Sehrodinger problems eonverge to the unique solution of OMT as 
explained below. 


Theorem 2: Given two probability measures fioidx) = po(x)dx, fiAdx) = pi(x)dx on M" with finite 

B E 

seeond moment, let Vq^ be the solution of the Sehrodinger problem with Markov kernel 

= (27r)-"'2(((- i,)£)-“/2exp (35) 

and marginals po, pi, and let Vt ’ be the eorresponding entropie interpolation. Similarly, let vr be the solu¬ 
tion to the OMT problem Q with the same marginal distributions, and pt the eorresponding displaeement 
interpolation. Then, eonverges weakl)|^ to vr and eonverges weakly to pt, as e goes to 0. 


To build some intuition on the relation between OMT and Sehrodinger bridges, eonsider 


dx(t) = y/edw{t) 


with w{t) being the standard Wiener proeess; the Markov kernel of x{t) is 
Sehrodinger bridge problem with the law of x{t) as prior, is equivalent to 


in (351. The eorresponding 


inf [ j —\\v{t,x)\\'^p{t,x)dtdx, (36a) 

{p.3') Jr" Jo 2e 

+ V ■ (vf,) - '-Ap = 0, (36b) 

p(0,x) = po{x), p{l,y) = pi{y). (36e) 


Note that the solution exists for all e and eoineides with the solution of the problem to minimize the eost 
funetional ^ 

/ / -\\v(t,x)\\‘^p(t,x)dtdx 

./lUn In Z 


instead, i.e., “resealing” P6a[ ) by removing the faetor 1/e. Now observe that the only differenee between 
( |3^ after removing the sealing 1 /e in the eost funetional and the OMT formulation (|^ is the regularization 
term |Ap in ( |36b[ ). Thus, formally, the eonstraint ( |36b[ ) beeomes ( [6b| ) as e goes to 0. Below we diseuss 
a general result that ineludes the ease when the zero-noise limit of Sehrodinger bridges eorresponds to 
OMT with (linear) dynamies. This problem has been studied in [[25l in a more abstraet setting based 
on Large Deviation Theory OSll . Here we eonsider the speeial ease that is eonneeted to our OMT-wpd 
formulation. To this end, we begin with the Markov kernel eorresponding to the proeess 

dx{t) = A{t)x{t)dt + y/eB{t)dw{t). 

The entropie interpolation Vt{dx) = p{t,x)dx ean be obtained by solving (the “resealed” problem) 


inf / 
dp 

— + V 
dt 


I -\\u(t,x)\\‘^p(t,x)dtdx, 

0 2 

{(A{t)x + B(t)u)p) - i ± = 0. 




dxidxq 


p(0, x) = po{x), p(l, y) = pi{y), 


(37a) 

(37b) 

(37e) 


sequence {Pn} of probability measures on a metric space 5 converges weakly to a measure P if fdPn —)■ fdP for every 

bounded, continuous function / on the space. 
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where a{t) = B{t)B{t)', see (3911, (Ml- This result represents a slight generalization of Dai Pra’s result 
in that the stoehastie differential equation eorresponding to (37b) may be degenerate (i.e., rank(a(f)) ^ n). 
Comparing ([ST]) with ([T5]) we see that the only differenee is the extra term 


e d‘^{a{i)ijp) 
2 ^ dxidx^ 

i,j=i ^ 


in ( |37b| ) as eompared to ( |15b[ ). Formally, ( |37b| ) eonverges to ( |15b[ ) as e goes to 0. This suggests that the 
minimizer of the OMT-wpd might be obtained as the limit of the joint initial-final time distribution of 
solutions to the Sehrodinger bridge problems as the diffusivity goes to zero. This result is stated next and 
ean be proved based on the result in (251 together with the Freidlin-Wentzell Theory (^ Seetion 5.6] (a 
large deviation prineiple on sample path spaee). In the Appendix, we also provide a direet proof whieh 
doesn’t require a large deviation prineiple. 


Theorem 3: Given two probability measures po{dx) = po{x)dx, pi{dx) = pi{x)dx on M" with finite 
seeond moment, let Pgi be the solution of the Sehrodinger problem with referenee Markov proeess 

dx{t) = A{t)x(t)dt + \/eB{t)dw{t) (38) 

and marginals po, pi, and let be the eorresponding entropie interpolation. Similarly, let tt be the solution 
to ( [T8] ) with the same marginal distributions, and pt the eorresponding displaeement interpolation. Then, 
■Pgi converges weakly to vr and eonverges weakly to pt as e goes to 0. 


An important eonsequenee of this theorem is that we ean now use the numerieal algorithm in 
whieh provides a solution to the Sehrodinger problem, for a vanishing e, as a means to solve the general 
problem of OMT with prior dynamies (and, in partieular, the standard OMT (J7l l. This is highlighted 
in the examples of Seetion |Vl} It should be noted that the algorithm, whieh relies on eomputing the 


pair {pq, Pi) in Theorem is totally different from other numerieal algorithms that solve standard OMT 
problems (3, (T3 . 


V. Gaussian marginals 


We now eonsider the eorrespondenee between Sehrodinger bridges and OMT-wpd for the speeial ease 
where the marginals are normal distributions. That the OMT-wpd solution eorresponds to the zero-noise 
limit of the Sehrodinger bridges is of eourse a eonsequenee of Theorem but in this ease, we ean obtain 
explieit expressions in elosed-form and this is the point of this seetion. 


Consider the referenee evolution 

dx{t) = A{t)x{t)dt -f y/eB{t)dw{t) 

and the two marginals 


Po{x) = 
Pl{x) = 


1 

V(2vr)-|Si 


: exp 


: exp 


--{x - mo)'So^(x - mo) 


--(x — mi)'Ej^ ^(x — mi) 


(39) 

(40a) 

(40b) 


where, as usual, the system with matriees {A{t), B{t)) is eontrollable. In our previous work 
we derived a “elosed-form” expression for the Sehrodinger bridge when mo = mi = 0, namely, 

dx{t) = {A{t) — B{t)B{tyil^{t))x{t)dt + \/eB{t)dw{t) 


(41) 
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with ne(t) satisfying the matrix Riccati equation 

n,(f) + A(f)U(t) + n,(t)A(t) - n,(f)5(t)5(f)'n,(f) = o 

and the boundary condition 

n.( 0 ) = + E;''"4;„Mr„‘E,Mr„'4.„E;-'")‘/"|E„-'''l 

When mo 7^ 0 or mi 0 the bridge becomes: 

dx{t) = {A{t) — B{t)B(tyil^{t))x{t)dt + B{t)B{tym{t)dt + \/eB{t)dw{t) 

where 

m{t) = 0)“^(mi — 0)mo) 

with $(t, s), M(t, s) satisfying 

s) 


dt 


and 


= {Ait) - B{t)B{tyiiyt))^{t, s), t) = i 


M{t,s)= / ^{t,T)B{t)B{ty^{t,TydT. 


(42) 

(43) 

(44) 

(45) 


Next we consider the zero-noise limit by letting e go to 0. In the case where A{t) = 0, B{t) = I, 
the Schrodinger bridges converge to the solution of the OMT. In general, when A{t) ^ 0, B{t) ^ I, by 
taking e = 0 in ( [43] ) we obtain 

n„(0) = E„-‘''"|E7"4;„Mr„‘4i„E;-'= - (E;-'=4;„Alr„'SiMr74,„E7")'/2|E„-‘'", (46) 


and the corresponding limiting process 

dx{t) = {A{t) — B{t)B{tyilo{t))x{t)dt + B{t)B{tym{t)dt, x(0) ~ (mo, Sq) (47) 

with no(f),m(f) satisfying ( |42l ), ( |45] ) and In fact no(f) has the explicit expression 
no(f) = -M{t, 0 )-i - M{t, 0 )-'$(f, 0 ) [-DloMfo'-hio - S-'/'(Sy'$;oMroiSiMfo'<I>ioSj/')i/ 2 ^-'^' 
-$(f, 0)'M(t, 0)-^<I>(f, 0)] <I)(f, 0)'M(f, 0)-^ (48) 


As indicated earlier, Theorem already implies that ( |47] ) yields an optimal solution to ( [T5] ). Here we 
give an alternative proof by directly verifying that the corresponding displacement interpolation and the 
control satisfy the conditions of Proposition 


Proposition 4: Let p{t, •) be the probability density of the process x{t) in ( |47| ), and 

u{t,x) = —B{tyilo{t)x + B{tym{t), 


then the pair {p,u) is a solution of the problem ([15]) with prior dynamics ([T3|) and marginals (|40|). 


Proof: To prove that the pair (p, u) is a solution, we show first that p satisfies the boundary condition 
p(l,a:) = pi{x), and second, that u{t,x) = BityVipf^x) for some f that satisfies the Hamilton-Jacobi 
equation ( |28b| ). 


Equation ( [47] ) is linear with gaussian initial condition, hence x{f) is a gaussian process. We claim 
that density of x{t) is 


p{t,x) = 


PWrW)\ 


exp 


--{x-n{f)yT.{f) \x-n{t)) 
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where 


n(t) = <l(t, 0)mo + / l>(t, r)-B(r)i?(r)'m(r)(ir 

Jo 

+sy'<l>(t, 0)'M(t, 0)-'<l>(t, 0)sy'l' So^/'$(0, t)M{t, 0) 


for t G (0,1]. It is obvious that E{a;(t)} = n{t) and it is also immediate that 

lim S(t) = Sq. 

t-5>0 

Straightforward but lengthy computations show that S(f) satisfies the Lyapunov differential equation 

t{t) = {A{t) - B{t)B{tyno{m{t) + mim - 

Hence, S(t) is the covariance of x{t). Now, observing that 
n(l) = <l>(l,0)mo+ [ <1(1, r)-B(r)i?(r)'m(r)(ir 

Jo 

= <l(l,0)mo+ [ <1(1, r)-B(r)-B(r)'<l>(l, r)'(irM(l, 0)“^(mi — <1(1, 0)mo) = mi 


S(l) = M(1,0)$(0,1)'S-'/' [(Sy'<h;oMro'SiMro'<hioS;/")'/']'s-'/"<h(0,l)M = Si, 


allows us to conclude that p satisfies p(l,a;) = pi{x). 


For the second claim, let 

1 

x) = —-x'Ilo{t)x + m{t)'x + c{t) 

with ^ 

c{t) = —- f m{T)'B{T)B{T)'m{T)dT. 

2 Jo 

Clearly, u{t,x) = BityW^jj while 

dib 1 

+ A{t)x ■ + -v^ ■ B{t)B{tyvyj 

= —-x't\.o{t)x + m{tyx + c{t) + x' A(ty {—IlQ(t)x + m(t)) 

+ ^(-a;'no(t) + m{ty)B{t)B{ty{-Ilo{t)x + m{t)) 

= ^x\A{tyUo + UoA{t) - Uo{t)B{t)B{tyUo{t))x - m(t)'(A(t) - B(t)B{tyUo{t))x + c{t) 
+x' A(ty {-Ilo(t)x + m(t)) + ^(-a;'no(t) + m(ty)B(t)B(ty {-Ilo(t)x + m(t)) 

= c(t) + -m(ty B(t)B(tym(t) = 0. 
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VI. Numerical examples 

We present two examples. The first one is on steering a eollection of inertial partieles in a 2- 
dimensional phase space between Gaussian marginal distributions at the two end-points of a time interval. 
We use the closed-form control presented in Section |Vj The second example is on steering distributions 
in a one-dimensional state-space with specified prior dynamics and more general marginal distributions. 
In both examples, we observe that the entropic interpolations converge to the displacement interpolation 
as the diffusion coefficient goes to zero. 


A. Gaussian marginals 


Consider a large collection of inertial particles moving in a 1-dimension configuration space (i.e., for 
each particle, the position x{t) G M). The position x and velocity v of particles are assumed to be jointly 
normally distributed in the 2-dimensional phase space ((a:, v) E M^) with mean and variance 


mo = 



and Eq = 


1 0 
0 1 


at f = 0. We seek to steer the particles to a new joint normal distribution with mean and variance 


mi 


5 

5 


and El 


1 0 
0 1 


at f = 1. The problem to steer the particles provides also a natural way to interpolate these two end-point 
marginals by providing a flow of one-time marginals at intermediary points t E [0,1]. 


When the particles experience stochastic forcing, their trajectories correspond to a Schrodinger bridge 
with reference evolution 


d 


x{t) 

v{t) 


0 1 
0 0 



0 

1 


y/edw{t). 


In particular, we are interested in the behavior of trajectories when the random forcing is negligible 
compared to the “deterministic” drift. 


Figure depicts the flow of the one-time marginals of the Schrodinger bridge with e = 9. The 
transparent tube represents the 3 ct region 

(^(f)'-m;)E“^(^(f)-mi) < 9, i{t) = 

and the curves with different color stand for typical sample paths of the Schrodinger bridge. Similarly, 
Figures and [^depict the corresponding flows for e = 4 and e = 0.01, respectively. The interpolating flow 
in the absence of stochastic disturbance, i.e., for the optimal transport with prior, is depicted in Figure 
Q the sample paths are now smooth as compared to the corresponding sample paths with stochastic 
disturbance. As e \ 0, the paths converge to those corresponding to optimal transport and e = 0. For 
comparison, we also provide in Figure]^ the interpolation corresponding to optimal transport without prior, 
i.e., for the trivial dynamics A{t) = 0 and B{t) = /, which is precisely a constant speed translation. 


x{t) 

v{t) 
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Fig. 1: Interpolation based on Sehrodinger bridge with e = 9 



Fig. 2: Interpolation based on Sehrodinger bridge with e = 4 



Fig. 3: Interpolation based on Sehrodinger bridge with e = 0.01 
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Fig. 4: Interpolation based on OMT-wpd 



Fig. 5: Interpolation based on OMT 


B. General marginals 


Consider now a large eolleetion of partieles obeying 


dx(t) = —2x(t)dt + u{t)dt 


in 1-dimensional state spaee with marginal distributions 


Po(a;) 


0.2 — 0.2cos(37ra;) -|- 0.2 
5 — 5 cos(67ra; — dvr) -|- 0.2 


if 0 < x < 2/3 
if 2/3 < a; < 1, 


and 

pl{x) = po(l - x). 


These are shown in Figure and, obviously, are not Gaussian. Onee again, our goal is to steer the state 
of the system (equivalently, the partieles) from the initial distribution po to the final pi using minimum 
energy eontrol. That is, we need to solve the problem of OMT-wpd. In this 1-dimensional ease, just like 
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Fig. 6: Marginal distributions 



Fig. 7: Interpolation based on OMT-wpd 


in the classical OMT problem, the optimal transport map y = T{x) between the two end-points can be 
determined fronn 

nx pT{x) 

/ Po{y)dy = / Pi{y)dy. 

The interpolation flow pt, 0 < t < 1 can then be obtained using ( |2^ . Figure depicts the solution of 
OMT-wpd. For comparison, we also show the solution of the classical OMT in figure where the particles 
move on straight lines. 

Finally, we assume a stochastic disturbance, 

dx{t) = —2x{t)dt -f u{t)dt + \/edw{t), 

withe > 0. Figure [9|-[r3l depict minimum energy flows for diffusion coefficients a/c = 0.5, 0.3, 0.15, 0.05, 0.01, 
respectively. As e —)■ 0, it is seen that the solution to the Schrddinger problem converges to the solution 
of the problem of OMT-wpd as expected. 


* In this 1-dimensional case, {22\ is a simple rescaling and, therefore, T{-) inherits the monotonicity of T{-). 






















20 


Q. 

>> 


Fig. 8: Interpolation based on OMT 




Fig. 9: Interpolation based on Schrodinger bridge with = 0.5 



Fig. 10: Interpolation based on Schrodinger bridge with = 0.3 
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Fig. 11: Interpolation based on Schrddinger bridge with = 0.15 




0 ^ 

Q 


Fig. 12: Interpolation based on Schrddinger bridge with = 0.05 




Fig. 13: Interpolation based on Schrddinger bridge with = 0.01 
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VII. Recap 

The problem to steer the random state of a dynamical system between given probability distributions 
can be equally well be seen as the control problem to simultaneously herd a collection of particles obeying 
the given dynamics, or as the problem to identify a potential that effects such a transition. The former 
is seen to have applications in the control of uncertain systems, system of particles, etc. The latter is 
seen as a modeling problem and system identification problem, where e.g., the collective response of 
particles is observed and the prior dynamics need to be adjusted by postulating a suitable potential so 
as to be consistent with observed marginals. When the dynamics are trivial and the state matrix is zero 
while the input matrix is the identity, the problem reduces to the classical OMT problem. Herein we 
presented a generalization to nontrivial linear dynamics. A version of both viewpoints where an added 
stochastic disturbance is present relates to the problem of constructing the so-called Schrodinger bridge 
between two end-point marginals. In fact, Schrddinger’s bridge problem was conceived as a modeling 
problem to identify a probability law on path space that is closest to a prior (usually a Wiener measure) 
and is consistent with the marginals. Its stochastic control reformulation in the 90’s has led to a rapidly 
developing subject. The present work relates OMT as a limit to Schrodinger bridges, when the stochastic 
disturbance goes to zero, and discusses the generalization of both to the setting where the prior linear 
dynamics are quite general. It opens the way to employ the efficient iterative techniques recently developed 
for Schrodinger bridges to the computationally challenging OMT (with or without prior dynamics). This 
is the topic of ifTTll . 


Appendix: Proof of Theorem[3] 


Let be the Markov kernel of ( [38] ), then 

q\s,x,t,y) = (27re)-"/2|M(f,s)|-'/2gxp 


- <I)(f, s)x)'M{t, s) \y- ^(f, s)a;)^ . 


Comparing this and the Brownian kernel q^'" we obtain 

q%s, X, f, y) = {t- s)’"/^|M(f, M(f, s)x, t, M{t, s)~^^'^y). 

Now define two new marginal distributions po and pi through the coordinates transformation C in ( [T9| ), 

Po{x) = |Mio|^/^|<l'iorVo(*^>ro^^io^^) 

Pi{x) = \Mio\^/^pi{m1^^x). 

Let {(pQ,pi) be a pair that solves the Schrodinger bridge problem with kernel and marginals po, pi, 
and define ((^f, pf) as 


pi{x) = \Miq\-^/‘^p^{M~q'‘^x), 


(50a) 

(50b) 


then the pair solves the Schrodinger bridge problem with kernel and marginals /5o,Pi- To 

verify this, we need only to show that the joint distribution 


'^qi\E)= I q^’^{0,x,l,y)po{x)p^{y)dxdy 




B/ 


^B/ 
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matches the marginals po,Pi- This follows from 


= |Mior/'|<h 


101 


1-1 


q^O, 1 , y)^o{^^oMl^^x)^i{y)dy 


-1 


= |Mior/2|<hio|-Vo($ro'^io'a;) =po(a;), 


JR" 

= |Mio|^/^ [ q''{0,x,l,Mll‘^y)(po{x)(pi{Mll^y)dx 

= I T^io I Vi (^10 ^1/) = Pi (y) ■ 

Be Be 

Compare Vqi with Vq^ it is not difficult to find out that Vq{ is a push-forward of V^i, that is, 

K' = c{Pii- 

On the other hand, let be the solution to elassieal OMT Q with marginals po,Pi, then 

TT'® = C^n. 

Now sinee Vq{’' weakly eonverge to vr^ from Theorem we eonelude that Pgi weakly eonverge to tt as 
e goes to 0. 

We next show VI weakly converges to yt as e goes to 0. The displacement interpolation y can be 
deeomposed as 


and 

[ (l^’"{0,x,l,y)^o{x)^f{y)dx 

JR" 


p(-) = 


(•) dTi{x,y), 


3)n vlUri 


where is the minimum energy path ( [T7] ) conneeting x, y, and 6^xy is the Dirae measure at on the 
path spaee. Similarly, the entropie interpolation V^ ean be deeomposed as 


VH-) = 


Qlyi-) dV^^{x,y), 


where Q^y is the pinned bridge [l40ll associated with ( |38] ) eonditioned on x(0) = x and a:(l) = y. It has 
the stochastic differential equation representation 

dx{t) = {A{t)—B{t)B{ty^{l, t))x{t)dt+B{t)B{ty^{l, t)~^ydt+\/eB{t)dw{t). 


As e goes to zero, it eonverges to 

dx{t) = {A{t) — B{t)B{ty^{l, t))x{t)dt + B{t)B{ty^{l, t)'M{1, t)~^ydt, x(0) = x, 

whieh is In other word, Qly weakly eonverges to 5j^y. This together with the faet that Vqi weakly 
eonverges to vr show that V^ weakly eonverges to yt as e goes to 0. 
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